Is getting the right answer just about choosing the right words? The role of syntactically-informed features in short answer scoring
نویسندگان
چکیده
Developments in the educational landscape have spurred greater interest in the problem of automatically scoring short answer questions. A recent shared task on this topic revealed a fundamental divide in the modeling approaches that have been applied to this problem, with the best-performing systems split between those that employ a knowledge engineering approach and those that almost solely leverage lexical information (as opposed to higher-level syntactic information) in assigning a score to a given response. This paper aims to introduce the NLP community to the largest corpus currently available for short-answer scoring, provide an overview of methods used in the shared task using this data, and explore the extent to which more syntactically-informed features can contribute to the short answer scoring task in a way that avoids the question-specific manual effort of the knowledge engineering approach.
منابع مشابه
Guessing in Multiple Choice Questions: Challenges and Strategies
Introduction: Guessing is one of the most challenging issues in multiple choice questions. Several strategies, such as negative scoring, have been suggested for preventing students from choosing the right answer just by chance. However, there is no general agreement on using such strategies. The aim of this study was to review the scoring methods which are used for reducing guessing, and evalua...
متن کاملA Study of Answer Changing Behavior in MC Tests: The Effect of the Academic Course, Field of Study, Gender and Teachers’ Attitude
This study investigated the answer changing behavior of the Iranian university students and its relationship to the academic course, gender, and field of study. 362 students at the University of Isfahan took part in the study. 76 English language teachers were also surveyed for their attitude toward answer changing on MC tests. The results indicated that 42.11% of the teachers had a negative at...
متن کاملPresentation of an efficient automatic short answer grading model based on combination of pseudo relevance feedback and semantic relatedness measures
Automatic short answer grading (ASAG) is the automated process of assessing answers based on natural language using computation methods and machine learning algorithms. Development of large-scale smart education systems on one hand and the importance of assessment as a key factor in the learning process and its confronted challenges, on the other hand, have significantly increased the need for ...
متن کاملPresentation of an efficient automatic short answer grading model based on combination of pseudo relevance feedback and semantic relatedness measures
Automatic short answer grading (ASAG) is the automated process of assessing answers based on natural language using computation methods and machine learning algorithms. Development of large-scale smart education systems on one hand and the importance of assessment as a key factor in the learning process and its confronted challenges, on the other hand, have significantly increased the need for ...
متن کاملThe use of appropriate colors in the design of children's rooms: A Short Review
color has the ability to inspire, excite, soothe, heal and even agitate. This is particularly true for children, who can be extra sensitive to color's impact. So the importance of picking out just the right color for a young child's room shouldn't be underestimated. When choosing colors to use for your rooms home it's important to think about the mood you want to create and whether you want it ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- CoRR
دوره abs/1403.0801 شماره
صفحات -
تاریخ انتشار 2014